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BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 
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GENERATE A THREE DIMENSIONAL MODEL 
OF AN ENVIRONMENT FROM RANGE SENSOR 
INFORMATION REPRESENTING A HEIGHT 
FIELD FOR THE ENVIRONMENT 
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TRACK POSITION AND ORIENTATION INFORMATION 
OF AT LEAST ONE IMAGE SENSOR IN THE 
ENVIRONMENT WITH RESPECT TO THE 
THREE DIMENSIONAL MODEL IN REAL-TIME 
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PROJECT REAL-TIME VIDEO IMAGERY INFORMATION 
FROM THE IMAGE SENSOR(S) ONTO THE THREE 
DIMENSIONAL MODEL BASED ON THE TRACKED 
POSITION AND ORIENTATION INFORMATION 
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VISUALIZE THE THREE DIMENSIONAL MODEL 
WITH THE PROJECTED REAL-TIME VIDEO 
IMAGERY IN A VIRTUAL ENVIRONMENT 
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MODEL CONDITIONED UPON VISIBILITY 
AS DETERMINED FROM THE DEPTH MAP IMAGE 
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PROJECT AND RESAMPLE POINTS IN RANGE 
SENSOR INFORMATION ONTO A REGULAR GRID 
ATA USER-DEFINED RESOLUTION 
TO PRODUCE A HEIGHT FIELD 
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PROCESS THE HEIGHT FIELD USING HOLE-FILLING 
AND TESSELLATION TO GENERATE A 
TRIANGLE MESH REPRESENTATION OF 
THE THREE DIMENSIONAL MODEL 
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IDENTIFY A STRUCTURE IN 
THE RANGE SENSOR INFORMATION 
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SELECT A SET OF GEOMETRIC PRIMITIVES 
BASED ON A SHAPE OF THE STRUCTURE 



FIT THE SET OF GEOMETRIC 
PRIMITIVES TO THE RANGE SENSOR 
INFORMATION WITH RESPECT TO 
THE IDENTIFIED STRUCTURE 
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REFINE THE THREE DIMENSIONAL MODEL 
BASED ON OBJECT SURFACES MAPPED FROM 
IMAGES ACQUIRED BY TH IMAGE SENSORS 
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ESTIMATE BACKGROUND IMAGE BY 
MODELING THE BACKGROUND IMAGE 
AS A TEMPORAL PIXEL AVERAGE 
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SUBTRACT THE BACKGROUND IMAGE 
— * FROM THE REAL-TIME VIDEO 

IMAGERY INFORMATION 
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IDENTIFY FOREGROUND OBJECT (S) IN 
THE SUBTRACTED REAL-TIME VIDEO IMAGERY 
INFORMATION USING A HISTOGRAM-BASED 
THRESHOLD AND MORPHOLOGICAL NOISE FILTER 
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VALIDATE THE FOREGROUND OBJECT(S) 
BY CORRELATION MATCHING BETWEEN IDENTIFIED 
OBJECTS IN NEIGHBORING IMAGE FRAMES 



OUTPUT THE VALIDATED FOREGROUND OBJECT(S) 
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